A Topic-based Reviewer Assignment System
نویسندگان
چکیده
Peer reviewing is a widely accepted mechanism for assessing the quality of submitted articles to scientific conferences or journals. Conference management systems (CMS) are used by conference organizers to invite appropriate reviewers and assign them to submitted papers. Typical CMS rely on paper bids entered by the reviewers and apply simple matching algorithms to compute the paper assignment. In this paper, we demonstrate our Reviewer Assignment System (RAS), which has advanced features compared to broadly used CMSs. First, RAS automatically extracts the profiles of reviewers and submissions in the form of topic vectors. These profiles can be used to automatically assign reviewers to papers without relying on a bidding process, which can be tedious and error-prone. Second, besides supporting classic assignment models (e.g., stable marriage and optimal assignment), RAS includes a recently published assignment model by our research group, which maximizes, for each paper, the coverage of its topics by the profiles of its reviewers. The features of the demonstration include (1) automatic extraction of paper and reviewer profiles, (2) assignment computation by different models, and (3) visualization of the results by different models, in order to assess their effectiveness.
منابع مشابه
Automatic Paper-to-reviewer Assignment, based on the Matching Degree of the Reviewers
There are a number of issues which are involved with organizing a conference. Among these issues, assigning conference-papers to reviewers is one of the most difficult tasks. Assigning conference-papers to reviewers is automatically the most crucial part. In this paper, we address this issue of paper-to-reviewer assignment, and we propose a method to model the reviewers, based on the matching d...
متن کاملChoosing a Better Moment to Assign Reviewers in Peer Assessment: The Earlier the Better, or the Later the Better?
Peer assessment continues to be a topic of interest in the educational arena for decades, especially with the popularity of MOOC in recent years. However, the reviewer assignment moment, which may affect the process efficiency and learning proactiveness reward, lacks appropriate consideration. In this study, we propose three reviewer assignment algorithms, postassignment, pre-assignment, and su...
متن کاملOn optimization of expertise matching with various constraints
This paper studies the problem of expertise matching with various constraints. Expertise matching, which aims to find the alignment between experts and queries, is a common problem in many applications such as conference paper-reviewer assignment, productreviewer alignment, and product-endorser matching. Most existing methods formalize this problem as an information retrieval problem and focus ...
متن کاملAn Optimization Algorithms-based Approach to District Health System Population Areas in Iran
Background: One of important subject in the operations' management fields is partitioning matter that was investigated in the study. This topic has recently received more attention from researchers of the healthcare management systems' field. This subject is important because planning about improvement of the healthcare system structure is considered as one of the most important management prob...
متن کاملAutomatizing the Assignment of the Submitted Manuscripts to Reviewers: A Systematic Review of Research Texts
Purpose: To systematicly review the automatazation of the assignment of the submitted manuscripts to reviewers in order to identify the status of research studies in this field in terms of types of evidence of expertise, types of retrieval models used, and the research gaps, and finally some suggestions for has been offered for future research. Method: The current research followed the systema...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- PVLDB
دوره 8 شماره
صفحات -
تاریخ انتشار 2015